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EXECUTIVE  SUMMARY 


The  Data  Link  Processor  (DLP)  Operational  Test  and  Evaluation/Integration  Test  Plan 
provides  the  overall  philosophy  and  approach  for  the  Integration  Testing  and 
Operational  Evaluation  of  the  DLP  System.  This  document  addresses  the  DLP 
integration  requirements  defined  in  the  National  Airspace  System  (NAS) 
Specifications  (NAS - SS - 1000)  and  in  the  documents  for  DLP's  detail  design  specified 
in  section  2.  Because  the  DLP  precedes  most  of  the  systems  with  which  it 
interfaces,  the  tests  defined  in  this  plan  require  simulating  multiple  Mode  Select 
Beacon  System  (Mode  S) ,  as  well  as  multiple  Mode  S  data  link- equipped  aircraft. 

For  the  same  reasons,  it  will  be  necessary  to  use  emulators  of  the  Weather  Message 
Switching  Center  Replacement  (WMSCR)  and  Automated  Weather  Observation  System 
(AWOS ) /Automated  Surface  Observing  System  (ASOS)  Data  Acquisition  System  (ADAS)  in 
the  testing  and  evaluation  of  the  DLP.  Every  effort  will  be  made  to  perform  end- 
state  testing  of  the  DLP  utilizing  live  data  and  emulators. 

The  primary  information,  contained  within  thi ;  plan  consioLb  of  the  following. 

a.  The  NAS-SS-1000,  Volume-I  (Appendix  III),  Volume-II,  and  Volume  V  DLP 
integration  requirements,  test  objectives,  test  descriptions,  and  completion 
criteria; 

b.  Conf iguration/Intt rface  Categories  and  Test  Categories; 

c.  Test  Verification  Requirements  Traceability  Matrix  (TVRTM). 
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1.  INTRODUCTION. 


The  provision  for  two-way  communication  with  aircraft,  via  a  digital  data  link,  ha 
long  been  considered  a  means  of  providing  significant  enhancements  for  safe  and 
efficient  flight  operations  and  reducing  controller  workload.  The  Data  Link 
Processor  (DLP)  being  tested  will  initially  perform  the  ground-based  data  link 
processing  functions  necessary  to  provide  appropriately  equipped  aircraft  with 
pilot  requested  aviation  weather  data  from  a  National  Weather  Data  Base  via  the 
Mode  Select  Beacon  System  (Mode  S)  data  link.  The  weather  data  base  will  contain 
six  products:  Surface  Observations  (SA),  Terminal  Forecasts  (FT),  ^iiot  Reports 
(UA) ,  Wind  and  Temperature  Aloft  Forecasts  (FD) ,  Radar  Summaries  (SD) ,  and 
Hazardous  Weather  Advisories.  The  DLP  is  being  implemented  in  multiple  phases;  an 
initial  state  (build-one)  DLP  system  is  being  tested,  a  build-two  system  that 
incorporates  additional  weather  services  and  an  initial  set  of  ATC  commands.  The 
build-three  system  adds  additional  ATC  services  and  finally,  the  end-state  DLP 
system  adds  more  weather  services.  The  initial  state  will  include  a  subset  of  the 
contemplated  end-state  requirements  as  given  in  the  NAS  System  Requirements 
Specification  (NAS  -  SR- 1000 )  and  the  NAS  System  Specification  (NAS - SS - 1000) .  This 
document  addresses  exclusively  the  requirements  of  the  initial  DLP  system  as  given 
in  the  Data  Link  Processor  Software  Segment  Specification  (FAA-OR-2802a)  and  the 
Data  Link  Processor  Hardware  Specification  (FAA-E-2794a) .  In  the  event  of  a 
conflict,  FAA-OR-2802a  shall  take  precedence . 

A  major  source  of  the  National  Aviation  Weather  Service  data  is  currently  the 
Weather  Message  Switching  Center  (WMSC)  in  Kansas  City,  MO.  Under  the  National 
Airspace  System  (NAS)  modernization  plan,  the  WMSC  will  be  replaced  by  two  WMSC 
Replacement  (WMSCR)  systems;  one  located  in  Salt  Lake  City,  UT ,  and  the  other 
located  in  Atlanta,  GA.  The  WMSCR  is  currently  scheduled  to  be  operational  in 
1992.  Automated  Weather  Observation  System  (AWOS)  and  Automated  Surface  Observing 
System  (ASOS)  will  provide  instantaneous  surface  observation  type  information 
automatically  at  their  locations.  The  AWOS  Data  Acquisition  System  (ADAS)  will 
concentrate  minute -by -minute  information  from  up  to  137  AWOS/ASOS  sites  for 
transmission  to  one  DLP.  The  ADAS  is  currently  scheduled  to  be  operational  in 
1992. 


The  Maintenance  Processor  Subsystem  (MPS)  will  monitor,  using  polled  requests, 
DLP's  operational  status  and  modes  in  real  time.  A  non-end  state  version  c-f  MPS 
currently  available. 


The  Mode  S  is  being  developed  under  the  auspices  of  che  Federal  Aviation 
Administration  (FAA)  as  an  upgrade  to  the  present  Air  Traffic  Control  Radar  Beacon 
System  (ATCRBS) ,  and  will  ultimately  provide  improved  surveillance  capabi  lity 
coupled  with  integrated  ground- air -ground  data  links  for  air  traffic  control  (ATC) 
and  non-ATC  communications.  The  DLP  is  currently  scheduled  for  delivery  and 
subsequent  integration  and  operational  evaluation  testing  at  the  FAA  Technical 
Center  before  an  operational  Mode  S  systems  will  be  available.  Because  the 
operational  DLP  must  interface  with  up  to  32  active  Mode  S  systems,  it  will  be 
necessary  to  use  some  means  of  simulating  multiple  Mode  S  sites.  Similarly,  the 
DLP  must  be  capable  of  servicing  up  to  2000  data  link-equipped  aircraft.  Because, 
at  most,  two  prototype  Airborne  Data  Link  Processors  (ADLP)/Avionics  systems  will 
be  available  at  the  FAA  Technical  Center  in  the  integration  testing  time  frame,  it 
is  imperative  to  simulate  multiple  data  link- equipped  aircraft. 
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MITRE  Corporation  is  under  contract  to  supply  WMSCR  and  ADAS  emulators  for  use  in 
DLP  Integration  Testing  and  Operational  Evaluation  at  the  FAA  Technical  Center. 
ACD-320  will  provide  a  Data  Link  and  Transponder  Analysis  System  (DATAS)  for 
simulation  of  multiple  Mode  S  sensors  and  more  than  2000  Mode  S  data  ] ink- equipped 
aircraft  for  operational  and  functional  integration  testing  of  the  DLP.  ACD-320 
will  also  provide  at  least  two  prototype  ADLP/Avionics  systems,  including  Mode  S 
transponders.  An  in-flight  operational  demonstration  of  the  DLP/Modc  S/ADLP  end- 
to-end  performance  testing  will  be  conducted  when  a  Mode-S  sensor  becomes  availabl 
at  the  FAA  Technical  Center. 

1.1  SCOPE. 

This  plan  defines  the  test  requirements  which  must  be  satisfied  to  assure  that  ’~he 
DLP  meets  the  minimum  acceptable  System  Level  Test  and  Evaluation  (SLT&E)  and  the 
Integration  Test  and  Evaluation  (IT&E)  requirements  identified  in  the  DLP  Test 
Verification  Requirements  Traceability  Matrix  (TVRTM)  presented  in  appendix  A  of 
this  document.  This  plan  shall  be  reviewed  and  approved  by  the  FAA  prior  to  the 
preparation  of  detailed  integration  test  procedures. 

1.2  PURPOSE. 

The  purpose  of  this  plan  is  to  define  the  approach,  methods,  resources,  and 
schedules  including  DLP's  error  detection  in  all  received  messages,  frames,  and 
packets  from  interfacing  systems,  and  protocol  levels  through  the  use  of  external 
simulators  and  emulators,  for  the  verification  of  the  DLP  requirements.  Detailed 
discussion  of  the  test  methods  associated  with  operational  and  procedural  type 
functions,  such  as  system  startup/restart,  system  update,  on-line  and  off-line 
reports  generation,  etc.,  will  be  contained  in  the  test  procedures.  This  plan 
provides  sufficient  detail  to  define  and  direct  the  development  of  detailed'  test 
procedures  and  to  identify  the  allocation  of  resources  required  to  support  this 
test.  Detailed  test  procedures  shall  be  developed  under  a  separate  document  in 
accordance  with  FAA-STD-02Aa. 


2.  APPLICABLE  DOCUMENTS. 


2 . 1  GOVERNMENT  DOCUMENTS . 

2.1.1  FAA  Specifications . 


NAS  PLAN 
NAS -DD- 1000 
NAS -SR -1000 
NAS -SS- 1000 
FAA-OR- 2802a 


NAS  Initial  State  Project 
NAS  Level  I  Design 

NAS  System  Requirements  Specification 
NAS  System  Specification 

Data  Link  Processor  Software  Segment  Specification 


FAA- E-2794a 


Data  Link  Processor  Hardware  Specification 


FAA-W48 -  094 


Data  Link  Processor  Weather  Data  Processing  and  Retrieval 
Requirements 

FAA- RD- 80 - 14A  The  Mode  Select  Surveillance  and  Communications,  ATC  and  Non-ATC 

Link  Protocols,  and  Message  Formats 

NAS-IR-25072503  WMSCR/DLP  Interface  Requirements  Document 

NAS - IR- 25082503  DLP/ADAS  Interface  Requirements  Document 

NAS  - IR- 43020001  NADIN/X.25  Packet  Mode  Users  Interface  Requirements  Document 

NAS  - IR- 5 1030002  Maintenance  Processor  Subsystem  to  Automation  Subsystems, 

Interface  Requirements  Document 

NAS - IR - 92020000  Coded  Time  Source  Interface  Requirements  Document  (Draft) 

NAS - IC - 25082503  DLP  to  ADAS  Interface  Control  Document 

NAS - IC - 25036403  DLP  to  WMSC  Interface  Control  Document 

NAS - IC - 25035 103  DLP  to  MPS  Interface  Control  Document 

NAS - IC - 2 5072503  DLP  to  WMSCR  Interface  Control  Document 
NAS  - IC- 34062503  DLP  to  Mode  S  Interface  Control  Document 

2.1.2  FAA  Standards. 

FAA-STD-024a  "Preparation  of  Test  and  Evaluation  Documentation” 

2.1.3  Occupational  Safety  and  Health  Administration  (OSHA)  Regulations. 

o<;ha-CFR-2^  CFR  1910  OSHA  Safety  and  Health  Standards 

2.1.4  Other  FAA  Documentation . 

FAA  Ord  1800. 8E  NAS  Configuration  Management 

FAA  Ord  1810.4b  F  Ao.  NAS  Test  and  Evaluation  Program 

FAA  Ord  1600.54b  FAA  Automated  Information  System  Security  Handbook 

NAS-MD-110  Test  and  Evaluation  Terms  and  Definitions  for  the  NAS 

NAS-MD-790  Maintenance  Processor  Subsystem  to  Remote  Monitoring  Subsystems 

and  Remote  Monitoring  Subsystem  Concentrators,  Interface  Control 
Document 

DLP  MTP  DLP  Master  Test  Plan 

The  documentation  hierarchy  and  interrelationships  are  depicted  in  figure  2-1. 
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DLP 

TEST  PROCEDURES 


FIGURE  2-1.  DLP  INTEGRATION  TEST  PLAN  DOCUMENTATION  TREE 


3.  DLP  OPERATIONAL  AND  INTEGRATION  TEST  PLAN  OVERVIEW. 


3.1  TEST  ANH  *  aLUATION  PHILOSOPHY. 

The  intebration  and  operational  evaluation  testing  conducted  at  the  FAA  Technical 
Cente*.  will  verify  the  system  level  integration  requirements  (e.g.,  performance, 
functional,  and  interface  characteristics)  of  the  DLP  system.  This  plan  and 
associated  test  procedures  will  accomplish  the  following: 

a.  Verify  the  DLP's  capability  to  properly  interface  and  function  with 
associated  equipment, 

b.  Provide  early  detection  of  interface  design  problems. 

c.  Ensure  that  operationally  effective  and  suitable  systems  are  implemented 
into  the  MAS. 

3.:  INTEGRATION  TEST  PLAN  AND  APPROACH. 

Integration  testing  will  require  testing  of  the  DLP  system  in  an  environment  as 
near  operational  as  possible.  The  DLP  testing  is  based  on  the  requirements  defin 
in  the  NAS-SS-1000,  Volume  I  (Appendix  III),  Volume  II,  and  Volume  V.  These 
requirements  have  been  reviewed  and  summarised;  similar  requirements  have  been 
assigned  a  unique  category  and  test  procedures  will  be  developed  to  address  each 
category.  Six  categories  are  listed  in  the  following  paragraphs  and  are 
defined  in  section  5  of  this  plan.  The  DLP  operational  configuration  is  shown 
in  figure  3.2.  1-1,  and  the  test  and  evaluation  configuration  is  shown  in 
f igure  3 . 2  .  1  -  2 . 

3.2.1  Test  Category  01  Interface  Requirements . 

The  test  category  01,  the  seven  systems  that  interface  with  the  DLP  system  will  b 
tested  on  an  individual  basis  initially,  then  integrated  into  a  fully  configurate 
system.  Depicted  below  are  the  interfaces  that  will  be  tested.  The  following 
order  does  not  establish  a  testing  priority  sequence: 

a.  Mode  Select  Beacon  System  (Mode  S) 

b.  Avionics  Data  Link  Processor  (ADLP) 

c.  Weather  Message  Switching  Center  Replacement  (WMSCR) 

d.  Weather  Message  Switching  Center  (WMSC) 

e.  AWOS  Data  Acquisition  System  (ADAS) 

f.  Maintenance  Processor  Subsystem  (MPS) 

g.  Coded  Time  Source  (CTS) 

h.  Full  Configuration 

Exhaustive  testing  of  DLP  error  detection  will  be  basic  to  interface  message, 
frame,  and  packet  processing. 


5 


Hourly  &  Specials 


NWS  WMSC 

-  Weather  Message 

Products  Switching  Center 


FIGURE  3.2.  1- 1 


DATA  LINK  PROCESSOR  SYSTEM  END  STATE  CONFIGURATION 
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3.2.2  Test  Category  02  Sasic  Systems  Operations . 

The  testing  that  will  be  conducted  within  test  category  02  shall  be  based  on  the 
successful  completion  of  tests  conducted  in  test  category  01.  Within  category  02, 
all  functional  and  operational  evaluation  functions  will  be  exercised  at  maximum 
capacity  levels  to  ensure  all  systems  satisfy  all  performance  specifications.  This 
test  will  simultaneously  test  all  of  the  DLP's  interfacing  systems.  Successful 
completion  of  this  test  will  demonstrate  that  the  DLP  can  function  and  operate  in 
the  NAS  environment. 

3.2.3  Test  Category  03  Startup,  Shutdown,  and  Restart. 

The  testing  within  test  category  03,  demonstrates  the  DLP  can  perform  the  indicated 
functions,  and  enable  personnel  to  follow  operational  procedures  typically  used  in 
an  actual  operational  environment  by  site  personnel. 

3.2.4  Test  Category  04  Reconfiguration . 

Test  category  04  will  be  conducted  to  ensure  that  changes  in  the  operational 
configuration  can  be  made  by  operational  personnel. 

3.2.5  Test  Category  05  Diagnostics . 

Testing  conducted  in  this  category  will  enable  the  operations  personnel  to  evaluate 
the  integrity  of  the  alarms,  alerts,  and  messages  produced  when  errors  are  entered 
during  testing. 

3.2.6  Test  Category  06  Security. 

These  tests  will  confirm  that  protective  measures  have  been  implemented. 


4.  DLP  OPERATIONAL  AND  INTEGRATION  TEST  PLAN  VERIFICATION  CONTROL. 


4 . 1  TVRTM . 

The  DLP  Integration  Test  Plan  TVRTM  contained  in  appendix  A  was  developed  ir. 
accordance  with  FAA- STD-024a ,  appendix  IV.  The  TVRTM  lists  the  applicable 
requirements  from  the  NAS-SS-1000,  Volume  I  (Appendix  III),  Volume  II,  and  Volume  V 
NAS  System  Specification.  Each  of  these  requirements  will  be  verified  by  the 
identified  methods,  i.e.,  test  and/or  demonstration,  through  the  successful 
completion  of  the  detailed  integration  test  procedures. 


5.  DLP  OPERATIONAL  AND  INTEGRATION  TEST  CATEGORIES. 


The  DLP  operational  and  integration  testing  consists  of  one  configuration  and  six 
test  categories.  This  section  will  define  each  category  identified  in  section  3. 
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5.1.1  Mode  S . 


These  tests  will  verify  the  requirements  related  to  the  DLP  interface  with  the 
Mode  S.  All  DLP  integration  testing  with  the  Mode  S  system  will  be  made  using 
DATAS  test  scenarios.  DATAS  will  satisfy  all  communication  protocols  of  Mode  S, 

i.e.,  any  Mode  S  protocol  directed  responses  to  communications  with  the  DLP  will 
automatically  and  routinely  be  satisfied  by  DATAS.  Each  DATAS  test  scenario  will 
be  an  input  file  to  DATAS  consisting  of  (1)  communication  messages  including  time 
of  message  transmission  to  the  DLP,  and  (2)  flags  to  direct  and/or  influence  Mode  S 
responses  to  messages  received  from  the  DLP. 

5. 1.1.1  Mode  S  Communications  Protocol  Testing . 

DATAS  will  read  a  DLP  communications  protocol  test  scenario  that  exercises  all 
measurable/testable  X.25  Link  Access  Procedures  Balance  (LAPB)  intercommunications 
protocol  requirements.  Because  the  DLP  uses  digital  microprocessors  to  execute  all 
line  driver  communications  protocol  functions,  this  test  scenario  will  simulate 
functions,  such  as  communications  line  dropouts,  timeouts,  and  failures  to  verify 
DLL's  communications  protocol  processing. 

5. 1.1.2  Mode  S  Testing . 

The  DATAS  test  scenario  associated  with  Mode  S  interface  testing  will  verify  that 
every  Mode  S/DLP  frame  is  processed  and/or  received  by  the  DLP.  The  frames  to  be 
tested  are  the  following: 


DLP 

to  Mode  S  Frames 

1. 

Standard  Uplink 

2. 

Extended  Length  Message  (ELM)  Uplink 

3. 

Request  for  Downlink 

Data* 

4. 

Message  Cancellation 

Request* 

5. 

Data  Link  Capability 

Request 

6. 

Request  for  Aircraft 

State 

7  . 

Request  for  Aircraft 

Position* 

8. 

Test  Message 

9. 

ATCRBS  ID  Request 

^frames  not  tested  in  build-one 


b.  Mode  S  to  DLP  Frames 

1.  Message  Rejection/Delay  Notice 

2.  Message  Rejection  Delay  Notice  with  Sensor  (Identifications  (ID)) 

3.  Sensor  Recovery  Notice 

4.  Uplink  Delivery  Notice 

5.  Pilot  Downlink 

6.  Pilot  Downlink  with  Position 

7.  Broadcast  Downlink* 

8.  Broadcast  Downlink  with  Position* 

9.  ELM  Downlink* 

10.  ELM  Downlink  with  Position* 

11.  Data  Link  Capability 
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12.  Aircraft  State 

13.  Aircraft  Position 

14.  Track  Drop 

15.  Test  Response  Message 

16.  Ground  Initiated  Downlink 

17.  Ground  Initiated  Downlink  with  Position 

18.  ATCRBS  ID  Code** 

19.  Track  Alert  Message** 

*frames  not  processed,  but  archived  by  DLP 
**frames  not  tested  in  build-one 

This  DATAS  Mode  S  test  scenario  verifies  that  DLP  will  receive,  process,  archive, 
or  transmit  every  message  in  the  Mode  S  interface. 

5,1,2  ADLP/Appllcations  Testing. 

Successful  completion  of  these  tests  will  verify  the  operational  interface  between 
the  DLP  and  ADLP  systems.  The  DATAS  ADLP  test  scenario  insures  that  every  weather 
product  in  the  weather  database  can  be  requested  by  simulated  ADLP - equipped 
aircraft  and  that  the  DLP's  responses  to  these  requests  are  timely  and  accurate. 

All  the  messages  associated  with  Mode  S  data  link  will  be  tested.  ADLP  integration 
testing  will  address  transport  level  data  units,  Mode  S  Packets,  and  Mode  S  frames. 

5. 1.2.1  Mode  S  Message  Testing. 

The  following  tests  will  verify  that  every  Mode  S  data  link  message  can  be 
received,  processed,  and  responded  to  by  the  ADLP  interface: 

a.  Uplink  and  Downlink 

1.  Application 

(a)  Weather  Request  Message 

2.  Transport  Data  Units  and  Mode  S  Packets 

(a)  Transport  Service  Data  Unit  (TSDU) 

(b)  Transport  Protocol  Data  Unit  (TPDU) 

(c)  Point-To-Point  Router  Hello  (PPRH)  PDU 

(d)  Level  1  End-System  Link  State  (Ll-ELS)  PDU 

(e)  Mode  S  R >ute  Packet 

(f)  Long  Mode  S  Packet  (MSP) 

(g)  Short  MSP 

The  DATAS  test  scenario  must  include  communications  protocol  interactions  between 
the  Mode  S  sensor  and  the  ADLP  that  force  these  messages  to  be  sent  to  or  received 
from  the  DLP. 

5. 1.2.2  Aircraft  Application  Weather  Product  Communications  Processing . 

The  purpose  of  these  tests  is  to  verify  that  pilots  can  request  weather  products 
from  the  DLP  via  the  ADLP  to  Mode  S  data  link  and  receive  the  DLP's  responses  to 
these  requests.  Every  weather  product,  and  their  associated  parameters,  will  be 
requested  by  a  DATAS  test  scenario  which  will  include  checking  every  possible  error 


10 


message  the  DLP  sends  to  the  ADLP.  Many  of  the  tests  conditions  in  the  DATAS  test 
scenario  will  be  closely  related  to  the  weather  database  update  tests  of  the  WMSCR 
emulator  and  ADAS.  Hence,  successful  DLP  responses  will  verify  both  DLP's  weather 
database  management  functions  and  DLP's  processing  of  requests  for  weather 
information.  The  DATAS  test  scenarios  will  be  based  on  requirements  of 
FAA-OR-2802a,  FAA-W48-094  (Revision  2),  the  MITRE  document  "Detailed  Data  Link 
Protocol  for  the  Weather  Communications  Processor,”  dated  2  August  1988;  and  "U.S. 
National  Aviation  Standard  for  Data  Link  Applications  of  the  Mode  Select  Beacon 
System,  Appendix." 

5,1.3  WMSCR  Testing. 

The  testing  of  this  interface  will  verify  the  operational  and  functional 
performance  of  the  DLP  with  the  WMSCR  system.  A  MITRE-supplied  WMSCR  emulator  will 
essentially  be  operationally  and  functionally  equivalent  to  the  WMSCR  system.  It 
will  be  used  in  all  tests  of  this  interface.  The  WMSCR  emulator  will  iccc've 
weather  product  information  from  the  WMSC  in  X3.28  protocol,  reformat  all  product 
information  for  transmission  to  the  DLP  using  X.25  communications  protocol,  and 
insert  special  weather  messages  to  test  DLP's  weather  database  updates  and 
maintenance.  The  WMSCR  weather  test  scenario  will  be  used  in  place  of  WMSC  live 
data  to  weather  database  updates  and  maintenance.  Many  of  the  tests  will  be 
performed  in  conjunction  with  the  ADLP's  weather  data  requests  via  DATAS  defined 
previously  in  section  5. 1.2. 2.  The  WMCSR  emulator  will  be  functionally  and 
operationally  equivalent  to  the  WMSCR  system  as  defined  in  the  WMSCR  Interface 
Control  Document.  WMSCR' s  weather  information  is  identical  to  that  of  WMSC.  Seven 
WMSCR  test  scenarios  will  be  used  to  test  the  DLP  to  WMSCR  interface.  The  test 
scenarios  are  the  following: 

a.  Surface  Observation  (SA)  Products  including: 

1.  Record  Special  Observation  (RS) 

2.  Supplementary  Observation  (SW) 

3.  Special  Observation  (SP) 

4.  Urgent  Special  Observation  (USP) 

5.  Correction  (COR) 

b.  Terminal  Forecast  (FT)  Products  including  International  Civil  Aviation 
Organization  (ICAO)  or  Military  Terminal  Forecast  (TAF) 

c.  Forecast  Winds  and  Temperature  Aloft  (FD) 

d.  Pilot  Report  (UA)  including  Urgent  Pilot  Report  (UUA) 

e.  Radar  Summary  (SD) 

f.  Hazardous  Weather  including: 

1.  Airmen's  Meteorological  Information  (AIRMET)  (WA) 

2.  Significant  Meteorological  Information  (SIGMET)  (WS) 

3.  Urgent  SIGMET  (UWS) 

4.  Convective  SIGMET  (WST) 

g.  Product  Interaction 
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5. 1.3.1  WMSCR  Communications  Protocol  Testing. 

The  WMSCR  emulator  will  demonstrate  and  verify  DLP's  communications  interface.  The 
DLP  and  the  WMSCR  system  will  communicate  using  X.25  LAPB  communications  protocol. 

5. 1.3.2  Weather  Product  Database  Testing. 

The  WMSCR  weather  product  test  scenarios  will  verify  the  DLP's  reception, 
processing,  and  maintenance  of  each  of  the  six  weather  products  in  the  weather 
database.  Scenarios  will  be  developed  for  each  weather  product  to  verify  its 
ability  to  handle  errors  in  the  text  of  the  message  and  one  scenario  to  verify 
interactions  associated  with  maintenance  of  the  six  weather  products  in  the  weather 
database.  Each  weather  product  test  scenario  will  be  developed  by  MITRE 
Corporation  and  will  require  use  of  the  WMSCR  emulator.  Verification  of  DLP's 
weather  product  database  update  and  maintenance  will  be  made  primarily  in 
conjunction  with  the  DLP  to  ADLP  interface  testing.  DLP  stability  testing  of  the 
WMSCR  interface  will  be  performed  using  live  WMSC  data  reformatted  by  the  emulator. 

There  may  exist  some  conditions/criteria  in  weather  product  processing  that  cannot 
be  realistically  tested  in  these  scenarios.  MITRE  will  identify  those 
conditions/criteria  not  tested. 

5.1.4  WMSC  Testing. 

All  testing  of  this  interface  will  be  made  to  demonstrate  DLP's  functional  and 
operational  performance  with  live  weather  communications  from  the  WMSC  system.  No 
formal  integration  tests  of  the  DLP's  weather  database  creation  and  maintenance 
functions  are  planned  for  the  interface  between  these  systems.  Because  the  format 
and  contents  of  WMSC  and  WMSCR  weather  information  are  similar,  WMSCR' s  controlled 
weather  test  scenarios  will  be  used  in  all  formal  testing  of  DLP's  weather  database 
update  and  maintenance  functions.  Stability  testing  of  DLP  will  be  demonstrated 
using  the  WMSC  system.  Stability  testing  will  consist  of  running  the  DLP  for  an 
1-week  period,  with  a  live  connection  to  the  WMSC  system.  DATAS  periodic  requests 
for  live  data  will  be  made  during  stability  testing. 

5.1.5  ADAS  Testing. 

The  testing  of  this  interface  will  verify  the  operational  and  functional 
performance  of  the  DLP  with  the  ADAS  system.  MITRE's  ADAS  emulator  is  basic  to  all 
testing  of  this  interface.  The  ADAS  emulator  will  provide  minute-by-minute  reports 
from  simulated  AWOS  or  the  ASOS .  The  ADAS  emulator  will  be  functionally  and 
operationally  equivalent  to  the  ADAS  system  defined  in  the  ADAS  Interface  Control 
Document . 

5. 1.5.1  ADAS  Communications  Protocol  Testing. 

The  ADAS  emulator  will  demonstrate  and  verify  DLP's  communications  interface.  The 
DLP  and  the  ADAS  system  will  communicate  using  X.25  LAPB  communications  protocol. 

5. 1.5.2  ADAS  Weather  Product  Database  Testing. 


AWOS/ASOS  automatic  sensed  weather  data  has  a  fixed  format  except  where  a  human 
operator  intervenes  and  submits  a  remarks  field  report  for  the  station.  All  ADAS 
weather  database  update  and  maintenance  criteria  are  defined  in  FAA-W48-094, 


Revision  2.  Ic  should  be  noted  that  the  MITRE  ADAS  test  scenarios  do  not  test  the 
logicial  expansion/interaction  between  bit  fields.  Testing  of  DLP's  ADAS  weather 
storage  will  be  performed  using  DATAS  weather  request  scenarios.  The  ADAS  weather 
data  received  from  the  MITRE's  ADAS  emulator  will  be  used  in  testing  this 
interfacing  system.  Functional  verification  of  this  interface  will  be  made  in 
conjunction  with  the  DATAS  and  the  ADAS  test  scenario. 

5,1,6  MPS  Testing . 

The  tests  specified  in  this  section  will  demonstrate  DLP's  Remote  Monitoring 
Subsystem  (RMS)  live  inter-operability  to  the  MPS.  Each  DLP  MPS  requirement  will 
be  validated  by  one  or  more  tests  and  each  test  may  cover  more  than  one 
requirement.  Traceability  between  the  requirements  and  these  tests  is  depicted  in 
appendix  A,  table  A-2. 

The  test  activities  will  primarily  focus  on  the  DLP  RMS  functions  which  are 
accessible  remotely  via  the  MPS  interface .  Testing  will  be  accomplished  by 
executing  these  RMS  functions  via  the  MPS  interface,  utilizing  the  ACN-230  Test 
Communications  (Testcom)  software,  or  the  Interim  Monitoring  and  Control  Software 
(IMCS).  This  will  verify  that,  although  link  level  communications  between  the  DLF 
RMS  and  the  MPS  are  conducted  according  to  X.25  Link  Access  Protocol  -  Balanced 
(LAPB)  at  the  application  level  the  interface  functions  as  specified  in 
NAS'5S-1000,  are  correctly  implementing  DLP  RMS  monitoring,  alarm,  command, 
certification,  and  diagnostic  functions. 

5. 1.6.1  Test  Categories. 

Six  separate  test  sequences  have  been  identified.  For  reference  purposes,  they  are 
identified  in  the  following  sections  as  Integration  Test  1  (1T1)  through  IT6. 

Among  these  tests,  the  following  interdependencies  have  been  identified: 

a.  IT1  is  independent  of  all  other  integration  tests. 

b.  IT2  through  IT6  are  dependent  upon  successful  completion  of  IT1,  but  are 
independent  of  each  other  and  may  be  conducted  in  any  order. 

5. 1.6 .1.1  IT1  Link  Level  Test. 

The  Link  Level  Interface  Test  will  confirm  that  the  link  level  communication  path 
between  the  DLP  RMS  and  the  MPS  can  be  established  and  maintained.  To  verify  the 
link  level  path,  the  MPS  running  Testcom  (or  IMCS)  is  used  to  communicate  with  the 
RMS.  Site  Data  Reports  (SDRs),  RMS  response  messages,  and  the  recorded  inspection 
data  for  the  DLP  will  be  analyzed  to  verify  the  results  of  this  test. 

5. 1.6. 1.2  IT2  Monitoring  Test . 

The  Monitoring  Test  will  confirm  that  each  parameter,  reported  by  the  DLP  RMS,  is 
consistent  with  the  state  of  the  DLP  system.  SDRs  will  be  generated  at  the  DLP  RMS 
and  sent  to  the  MPS.  The  SDRs,  and  recorded  inspection  status  data  for  the  DLP. 
will  be  analyzed  to  verify  the  results  of  this  test. 
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5.1.6. 1.3  IT3  Alarm  Test. 

The  Alarm  Test  will  confirm  that  the  DLP  RMS  will  correctly  respond  to  the  DLP 
alarm  conditions  via  the  MPS  interface.  The  responses  received  by  the  MPS ,  and  the 
recorded  inspection  data  for  the  DLP,  will  be  analyzed  to  verify  the  results  of 
this  test. 

5 .1.6. 1.4  IT4  Command  Test . 

The  Command  Test  will  confirm  that  the  DuF  RMS  will  correctly  respond  to  commands 
sent  via  the  MPS  interface .  The  responses  received  by  the  MPS,  and  the  recorded 
inspection  data  for  the  DLP,  will  be  analyzed  to  verify  the  results  of  this  test. 

5.1.6. 1.5  IT5  Certif ication  Test. 

The  Certification  Test  will  confirm  that  the  DLP  RMS  will  correctly  respond  to  the 
certification  commands  sent  via  the  MPS  interface.  The  responses  received  by  the 
MPS,  and  the  recorded  inspection  data  for  the  DLP,  will  be  analyzed  to  verify  the 
results  of  this  test. 

5. 1.6 .1.6  IT6  Diagnostic  Test . 

The  Diagnostic  Test  will  confirm  that  the  DLP  RMS  will  correctly  respond  to 
diagnostic  commands  issued  via  the  MPS  interface.  The  r-‘ rp''r'sec  r°c'>ived  by  the 
MPS,  and  the  recorded  inspection  data,  for  the  DLP  will  be  analyzed  to  verify  the 
results  of  this  test. 

5,1.7  CTS  Testing. 

This  test  will  verify  that  the  DLP  can  interface  with  and  receive  time  from  the 
CTS  system.  The  CTS  provides  Julian  day  of  year  and  time  of  day  plus  codes  that 
indicate  accuracy  of  time  information.  The  exact  format  of  the  one  message  sent  by 
the  CTS  shall  be  in  accordance  with  the  CTS  (Interface  Control  Document  (ICD) . 

5.2  TEST  CATEGORY  02  BASIC  SYSTEMS  OPERATIONS. 

Tests  successfully  completed  within  this  category  will  demonstrate  that  the  DLP  can 
be  integrated  into  the  NAS  whenever  all  interfacing  systems  are  available.  This 
test  incorporates  all  of  the  functional  and  operational  characteristics  of  the  DLP 
as  identified  in  the  category  associated  with  each  interfacing  system.  The  full 
configuration  operational  and  stability  performance  of  the  DLP  is  included  in  this 
test  category.  This  test  includes  the  following  basic  functional  requirements  of 
the  DLP : 

a.  Weather  product  acquisition  storage  and  maintenance  from  the  WMSCR  and  ADAS 
emulators  plus  live  data  from  WMSC 

b.  Weather  product  retrieval 

c.  Weather  product  transmission  to  aircraft  via  Mode  S  sensors 

d.  Maintenance  of  the  aircraft  ADLP  to  DLP  communication  link  via  Mode  S 
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e.  MPS  polling 

f.  Capacity  and  performance  testing 

Testing  of  these  functions  will  be  performed  on  the  DLP  using  appropriate  scenarios 
for  weather  product  sources  and  requests.  These  requirements  will  be  tested  using 
DATAS  coupled  with  the  WMSCR  and  ADAS  emulators. 

5.2.1  Test  Description . 

The  following  test  description  shows  the  interaction  between  testing  the  DLP ' s 
functions  of  storing  and  maintaining  a  weather  database  and  the  servicing  of 
requests  for  weather  information  from  this  database.  This  interaction  is 
summarized  in  figure  5. 2. 1-1. 

a.  Weather  Product  Acquisition,  Storage,  and  Maintenance 

During  this  test,  the  weather  source  will  be  the  simulated  WMSCR  and  ADAS 
emulators.  The  emulator  test  drivers  will  read  previously  prepared  weather  product 
data  (canned  weather)  and  transmit  it  in  appropriate  format  to  the  DLP.  This  data 
will  consist  of  valid  data  and  will  include  at  least  one  example  of  each  type  of 
weather  product  in  the  full  variety  of  formats  expected  from  WMSCR.  The  DATAS, 
using  its  test  scenarios  derived  from  the  above  emulator  weather  test  scenarios, 
will  then  issue  requests  for  all  these  products,  and  compare  the  DLP  responses  with 
predicted  results  based  on  the  canned  weather.  If  the  weather  product  received  by 
the  DATAS  simulated  Mode  S  sensor  agrees  with  the  predictions  based  on  the  canned 
weather,  it  can  be  concluded  that  the  canned  weather  product  was  properly  acquired 
and  maintained  by  the  DLP. 

The  canned  weather  data  will  include  a  liberal  mixture  of  erroneous  data,  and  a 
sufficient  spectrum  of  pilot  reports  and  hazardous  weather  advisories  to  exercise 
the  spectrum  of  weather  requests.  Date-time  groups  in  the  weather  products  will  be 
adjusted  to  produce  gradual  and  predictable  expiration  of  the  products.  The  DATAS 
will  issue  requests  for  all  products  in  the  canned  weather  and  compare  responses 
with  predicted  results. 

At  the  end  of  the  test,  the  weather  reject  log  will  be  reviewed  to  ensure  that  all 
erroneous  weather  products  have  been  properly  logged,  and  that  no  valid  weather 
products  appear.  The  weather  reject  log  and  the  transaction  file  will  be  reviewed 
to  estimate  the  storage  delay  time,  which  is  also  available  from  the  simulator 
logs . 

b.  Weather  Product  Request  Processing 

This  test  case  is  concerned  with  Mode  S  to  ADLP  communications.  The  testing  under 
a.  Weather  Product  Acquisition,  Storage,  and  Maintenance,  should  be  sufficient  to 
demonstrate  that  the  DLP  processing  of  valid  requests  satisfies  requirements. 

Invalid  and  improperly  constructed  requests  still  need  to  be  tested.  The 
DATAS  will  issue  a  set  of  data  link  messages  with  all  possible  type  codes 
(0-FF  hexidecimal) ,  as  the  first  byte  in  an  otherwise  well  constructed  pilot 
downlink  without  position.  Most  of  these  are  invalid  and  should  be  archived  but 
elicit  no  response  from  the  DLP. 
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WMSC 

Weather  Data  Processing  Related  Functions 

X3 .28 

WMSCR  Emulator 

1  WMSC  Live  Data 

2  WMSCR  Wx  Test 
Scenario 


ADAS  Emulator  (multiple 
AWOS/ASOS  LOCIDs) 

1  ADAS  Wx  Test 
Scenario 


DLP  SUBSYSTEM 


WMSCR  Interface 

Transaction 

with  the  Weather 

Processor 

Manager  (WM)  CSC 

(TP)  CSC 

ADAS  Interface 
with  the  Weather 
Manager  (WM)  CSC 


Performance  Monitor  (PM) 
&  Remote  Maintenance 
Monitoring  (RMM)  CSCs 


DATAS  (Wx  Data  Retrieval  Related  Functions) 


X . 25  Mode  S  Protocol  Test  Driver 
(Tests  all  Mode  S/DLP  messages) 

ADLP  Protocol  Test  Driver 
(Tests  all  ADLP/DLP  messages) 

DATAS  Wx  Test  Scenario  derived  from 
WMSCR  and  ADAS  Emulator  Wx  Tests 

a.  WMSCR  Wx  Test  Scenario 

b.  ADAS  Wx  Test  Scenario 


Figure  5. 2. 1-1  DLP  Test  Block  Diagram 


c.  Weacher  Product  Transmission 


The  previous  test  cases  have  adequately  exercised  the  Mode  S  interface  to 
demonstrate  compliance  with  these  requirements. 

d.  End-to-End  Testing 

This  test  involves  the  WMSC  live  weather  product  source  (one  or  more  live  Mode  S 
sensors  in  communication  with  deployed  Mode  S  ADLP  equipped  aircraft  issuing 
weather  product  requests) .  This  test  will  be  an  important  part  of  IT&E  because  it 
demonstrates  the  Mode  S  data  link  capability.  DATAS  will  be  used  in  conjunction 
with  full  end- to  end  testing  to  provide  additional  assurance  that  the  functional 
requirements  to  communicate  with  multiple  targets  have  been  met. 

e.  MPS  Polling  and  DT.P  Responses 

The  MPS  interface  will  be  excercised  via  normal  MPS  polling  of  the  DLP. 

f.  A  test  scenario  will  be  executed  by  DATAS  which  exc<=rises  all  DLP  capacity 
constraints;  namely,  number  of  active  aircraft  (2000)  and  weather  product  request 
rates  (throughput  performance ) .  Weather  products  storage  capacity  (i.e.,  number  of 
SAs)  will  have  previously  been  tested  during  ARCON's  DT&E. 

5.2.2  NAS  Requirements. 

This  test  shall  verify  the  following  requirements: 

NAS  - SS -  1000  3 . 2  .  1 . 5 . 3 . 2. 3 ,  and  SSS/DLP  3.1.1  through  3. 1.4. 2,  10.1  through 
10.5.9.6. 

5.2.3  Criteria  of  Success . 


The  successfully  coir  leted  and  approved  verification  of  the  requirements  specified 
in  5.2.2  shall  be  considered  as  the  criteria  for  success  of  this  test  procedure. 

5.2.4  Test  Configuration . 

Category  02  tests  shall  be  performed  on  the  configuration  shown  in  figure  3.2.  1-2. 

5.2.5  Support  Hardware . 

The  following  support  hardware  is  required:  DATAS's  Mode  S  to  ADLP  Application 
simulation,  the  WMSCR  and  ADAS  emulators,  the  Technical  Center's  MPS  testbed,  and  a 
protocol  analyzer  model  HP-4952.  End-to-end  testing  requires  a  live  Mode  S  sensor 
and  an  airborne  avionics  system,  including  a  Mode  S  data  link  capable  ADLP 
transponder,  plus  input  output  capabilities. 

5.2.6  Support  Software . 

Software  to  support  the  DATAS's  Mode  S  simulation,  ACN-230  MPS  Testcom,  and  the 
IMCS  software  is  required. 
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5.2.7  Special  Test  Equipment . 

No  special  Cest  equipment  has  been  identified  to  date. 

5.2.8  Data  Analysis . 


This  test  will  be  precisely  scripted  WMSCR/ADAS  emulator  weather  data  test 
scenarios  and  the  DATAS  test  scenarios  derived  from  them.  The  deviation  of  system 
responses  from  these  scripted  test  scenarios  results  in  test  failure.  The  normal 
outputs  generated  during  this  test  will  be  archived  by  both  DATAS  and  the  DLP ,  with 
listings  generated  as  required.  These  files  are  part  of  the  documentation. 

5.2.9  Documentation . 


Documentation  of  Test  Category  02  test  performance  and  results  shall  be  in 
accordance  with  section  7  of  this  document.  The  normal  outputs,  generated  during 
this  test,  will  be  captured  to  a  magnetic  medium  via  the  archiving  feature  of  the 
DLP;  listings  will  be  generated  as  required.  These  files  are  a  part  of  the 
documentation . 

5.3  TEST  CATEGORY  03  STARTUP.  SHUTDOWN  AND  RESTART. 

These  tests  shall  demonstrate  that  Startup,  Shutdown  and  Restart  functions  of  the 
DLP  can  be  performed  with  results  in  accordance  with  conditions  and  requirements 
specified  in  the  TVRTM. 

5.3.1  Test  Description. 

Test  personnel  shall  execute  test  scenarios  associated  with  Startup,  Shutdown  and 
Restart  of  the  DLP.  Each  of  the  above  functions  shall  produce  results  in  strict 
accordance  with  requirements  given  in  the  TVRTM.  Any  deviation  from  these 
requirements  shall  constitute  a  failure  of  the  function  being  tested. 

5.3.2  NAS  Requirements. 

Tests  in  this  category  shall  verify  the  following  requirements: 

SSS/DLP  3.1. A. 3.1,  3. 1.4. 3. 2,  and  3. 1.4.3. 3. 

5.3.3  Criteria  of  Success . 


The  successfully  completed  and  approved  verification  of  the  requirements,  as 
specified  in  section  5.3.2,  and  the  TVRTM,  shall  be  considered  as  the  criteria  for 
success  of  these  tests  procedures. 

5.3.4  Test  Conf ito'-ation. 

Category  03  tests  shall  be  performed  on  the  configuration  shown  in  figure  3.2.  1-2. 

5.3.5  Support  Hardware . 

No  support  hardware  has  been  identified  to  date. 
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5.3.6  Support  Software . 

No  test  support  software  has  been  identified  for  this  testing. 

5.3.7  Special  Test  Equipment . 

No  special  test  equipment  has  been  identified  to  date. 

5.3.8  Data  Analysis . 

This  test  is  either  pass  or  fail,  based  on  the  DLP's  performance. 

5.3.9  Documentation . 

Documentation  of  Category  03  test  performance  and  results  shall  be  in  accordance 
with  section  7  of  this  document.  The  normal  outputs,  generated  during  this  test, 
will  be  captured  to  a  magnetic  medium  and  listings  generated  as  required.  These 
files  are  a  part  of  the  documentation. 

5.4  TEST  CATEGORY  09  RECONFIGURATION. 

Test  personnel  will  use  those  menus  associated  with  DLP  operational  parameter 
changes  to  verify  changes  in  the  operational  configuration. 

5  a.l  Test  Description . 

A  test  scenario  will  be  executed  by  test  personnel  which  exercises  everv 
requirement  description  listed  in  the  DLP  TVRTM. 

5.9.2  NAS  Requirements . 

These  tests  shall  verify  the  following  DLP  requirements: 

SSS/DLP  3. 1.4. 3.4.1,  3. 1.4. 3. 4. 2,  and  3. 1.4. 3. 5. 

5.4.3  Criteria  of  Success . 


The  successfully  completed  and  approved  verification  of  the  requirements,  as 
specified  in  section  5.4.1  and  for  each  requirement  specified  in  the  TVRTM,  shall 
be  considered  as  the  criteria  for  success  of  these  test  procedures. 

5.9.4  Test  Conf ieurat ion . 

These  tests  shall  be  performed  on  the  configuration  shewn  in  figure  3. 2. 1-2. 

3.9.5  Support  Hardware . 

No  special  support  hardware  has  been  identified  for  this  test. 

3.9.6  Support  Software . 

No  special  support  software  bar  been  identified  for  this  test. 

5.9.7  Special  Test  Equipment . 

No  special  test  equipment  has  been  identified  to  date. 
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5.4,8  Data  Analysis  . 


All  changes  made  in  the  DTP's  operational  configuration  shall  be  in  strict 
accordance  with  the  operational  parameters  modified  by  the  test  scenario. 

5.4.9  Documentation . 


Documentation  of  these  test  performance  and  results  shall  be  in  accordance  with 
section  7  of  this  document.  The  normal  outputs,  generated  during  this  test,  will 
be  captured  to  a  magnetic  medium  and  listings  generated  as  required.  These  files 
are  a  part  of  the  documentation. 

5.5  TEST  CATEGORY  05  DIAGNOSTICS. 

This  test  category  includes  inventory  of  hardware  elements  and  support  software 
controlling  the  basic  hardware  elements,  such  as  memory,  mass  storage,  tape  drive.'., 
printers,  Cathode  Ray  Tube  (CRT)  terminals,  and  communication  interface  devices. 
Diagnostic  software,  supplied  with  the  DLP  hardware  configuration  items,  is  test,  ed 
as  well  as  the  application  and  the  system  software  diagnostic  repertoire.  Tie- 
Reliability  and  Performance  Demonstration  (R&PD)  is  also  included  in  this  testing. 

5.5.1  Test  Description . 

The  test  procedures  developed  for  this  testing  shall  verify  the  basic  interfaces 
between  FAA  personnel  and  the  new  hardware  that  comprise  the  DLP  system  Thev 
shall  confirm  the  ability  to  perform  the  diagnostics  and  the  accuracy  of  *L< 
supplied  software  and  procedures.  They  shall  demonstrate  the  ability  of  the  sw-  : 
to  meet  the  performance  and  reliability  requirements.  These  rests  are  parti tion.-d 
into  two  sub-tests:  (1)  Functionality  Demonstration,  and  (2)  R&PD. 

5. 5. 1.1  Functionality  Demonstration . 

Test  personnel  shall  power  each  associated  unit  up  and  down  and  observe  the  s.-v,.:; 
reactions.  They  shall  execute  all  features  and  options  of  the  diagnostic  sof : w.,r- 
supplied  with  the  DLP  system.  They  also  verify  the  functionality  of  the  fault 
detection,  isolation,  and  correction  capabilities  of  the  Sequoia  computer  svst,er 
These  tests  will  primarily  be  the  same  as  many  of  the  hardware  factor-/  accept-  tree 
test  run  by  CONTEL.  They  shall  exercise  such  things  as  the  mount,  dismount .  ". 

read,  write,  and  protection  capabilities  of  the  magnetic  tape  hardware,  and 
supporting  software. 

5.  5.  1.2  Reliability  and  Performance  Demonstration . 

The  R&PD  will  consist  of  a  continuously  running  DLP  program  operating  wirh 
emulators  and  simulators  providing  weather  data  and  Mode  S/ADLP  interfaces  un. 
normal  load  conditions.  The  DLP  will  be  run  continuously  for  1  week  r  o  ..u-cumu  •  ■ ; 
performance  statistics  and  the  mean  time  to  failure  of  the  system.  DATAS  wil 
routinely  make  various  requests  for  weather  information  during  this  rest 
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5.5.2  NAS  Requirements. 

These  tests  shall  verify  the  following  requirements: 

SSS/DLP  3.1.1,  3. 1.4. 2. 3,  3. 1.4. 5. 9.1,  3. 1.4. 5. 9. 3,  3. 1.4. 5. 9.4,  3. 1.4. 5. 9. 5,  and 
10 . 5 . 9 . 7ff . 

HWS/DLP  3.1. Iff,  3.1. 2ff ,  3.1.3ff,  3.2. Iff,  3.2.3ff,  and  3. 2. 4. 3. 

5.5.3  Criteria  of  Success . 


The  successfully  completed  and  approved  verification  of  the  requirements,  as 
specified  in  both  section  5.5.2  and  with  the  identified  methods  for  each 
requirement  in  the  TVRTM,  shall  be  considered  as  the  criteria  for  success  of  these 
test  procedures. 

5.5.4  Test  Configuration . 

Category  05  tests  shall  be  performed  on  the  configuration  shown  in  figure  3.2.  1-2. 

5.5.5  Support  Hardware. 

All  DLP  hardware  elements  and  simulators  and  emulators  are  required  for  these 
tests . 

5.5.6  Support  Software. 

The  defined  R&PD  program  and  data  generators  supporting  simulation  scenarios  are 
required  for  the  R&PD  test. 

5.5.7  Special  Test  Equipment . 

No  special  test  equipment  has  been  identified  to  date. 

5.5.8  Data  Analysis. 

a.  With  regard  to  the  functional  requirements  being  tested,  this  test  will  be 
precisely  scripted  in  the  test  procedures  so  that  deviations  of  system  responses 
from  the  script  result  in  test  failure 

b.  Performance  and  reliability  requirements  will  require  statistical  analysis  to 
evaluate  the  results,  i.e.,  if  no  failures  are  observed,  a  lower  limit  on  the  mean 
time  to  failure  may  be  estimated  statistically. 

5.5.9  Documentation . 


Documentation  of  these  tests  performance  and  results  shall  be  in  accordance  with 
section  7  of  this  document.  The  outputs  generated  during  this  test  will  be 
captured  to  a  magnetic  medium  and  listings  generated  as  required.  These  files  are 
part  of  the  documentation. 
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5.6  TEST  CATEGORY  06  SECURITY. 

The  need  to  implement  security  into  the  DLP  software  is  a  must  to  restrict  unwanted 
access  to  the  databases.  Two  levels  shall  be  included  with  the  first  being  a  means 
to  automatically  generate  a  log-on  record  and  enable  the  user  general  purpose 
utilitization.  The  second  level  shall  be  more  restritive  and  be  available  for 
those  who  have  a  need  to  know. 

3.6.1  Test  Description. 

Testing  shall  be  conducted  that  will,  demonstrate  that  with  correct  access  personnel 
will  be  permitted  to  propertly  operate  the  functional  aspects  or  the  DLP  system. 
Equal  testing  will  demonstrate  that  improper  access  will  not  be  permitted. 

5.6.2  NAS  Requirements . 

There  are  no  specific  requirements  stated  for  this  in  the  DLP  specifications,  but 
is  required  as  per  FAA  Order  1600.54b. 

6.  DLP  TESTING  ORGANIZATIONAL  ROLES  AND  RESPONSIBILITIES’. 


The  principal  groups  involved  in  the  DLP  Integration  Test  activities  are  the  test 
management  group  and  the  test  support  group. 

6.1  DLP  TEST  MANAGEMENT  GROUP. 

6.1.1  Composition  of  the  DLP  Test  Management  Group. 

"he  DLP  test  management  group  will  be  composed  of  representatives  from  FAA  agencies 
and  support  contractors.  Specifically,  it  will  be  composed  of  one  member  from 
each  of  the  following  organizations:  ACN-220  (who  will  chair  the  group),  ASM- 160, 
AAC-942D,  ACD-320,  ACN-230,  MITRE,  MiTech,  STI ,  and  System  Engineering  and 
Integration  (SEI)-  Technical  Center  Operations  (TCO) . 

6.1.2  Role  of  the  DLP  Test  Management  Group. 

The  role  of  this  group  is  to  direct  all  test  efforts  relative  to  the  DLP  Test  and 
Evaluation  (TOE)  activities.  The  DLP  test  management  group  will  coordinate  and 
assign  particular  tasks  to  each  organization  represented  in  the  DLP  test  support 
group . 

6.1.3  Responsibilities  of  the  DLP  Test  Management  Group. 

Specific  responsibilities  of  the  DLP  test  management  group  are  the  following: 

a.  Establish  and  promulgate  policies  related  to  the  DLP  T&E  activities. 

b.  Concur  with  all  test  plans  and  procedures  related  to  the  DLP  T&E 
ac  t i vi t ies . 
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c.  Distribute  DLP  T&E  activity  related  documentation  to  all  participating 
organizations  for  review. 

d.  Assign  roles  and  responsibilities  to  the  DLP  T&E  test  support  group. 

6.2  DLP  TEST  SUPPORT  GROUP. 

6.2.1  Composition  of  the  DLP  Test  Support  Group. 

The  DLP  test  support  group  will  be  composed  of  representatives  from  FAA  agencies 
and  support  contractors .  Specifically,  it  will  be  composed  of  specialists 
knowledgeable  in  specific  technical  areas  and  DLP  TVRTM  requirements  selected  by 
the  test  management  group  from  the  following  organizations:  ACN-220  (who  will 
define,  direct  and  manage  the  tests),  ACN-210,  ASM-160,  ACD-320,  AAC-942D,  MITRE, 
MiTech,  STI ,  and  SEI .  Each  organization  will  be  responsible  to  assign  its 
personnel  to  accomplish  its  tasks  as  assigned  by  the  DLP  test  management  group. 
ALG-400  will  designate  a  Quality  Reliability  Officer  who  will  be  responsible  for 
quality  assurance.  The  level  of  support  required  of  each  organization  is  specified 
below  in  section  6. 4. 2. 2. 

6.2.2  Role  of  the  DLP  Test  Support  Group . 

The  role  of  the  test  support  group  will  be  to  support  the  DLP  test  management  group 
in  developing  test  requirements,  plans,  procedures,  and  scenarios.  The  test 
support  groups  will  also  conduct  actual  tests,  write  test  reports,  perform  test 
analysis,  and  other  such  roles  as  the  DLP  management  group  may  assign.  Personnel 
from  this  group  will  provide  the  services  necessary  to  establish,  schedule, 
maintain,  and  control  test  facilities  for  conducting  the  DLP  T&E  effort. 

6.2.3  Responsibilities  of  the  DLP  Test  Support  Group. 

6. 2 .3.1  Specific  Responsibilities  of  the  DLP  Test  Support  Group. 

The  DLP  test  support  group  are  responsibile  for  the  following: 

a.  Develop  DLP  test  plans,  scenarios,  and  procedures  as  directed  by  the  DLP 
test  management  group. 

b.  Review  DLP  test  plans,  scenarios,  procedures,  success  criteria,  and  analyze 
documentation  in  assigned  areas. 

c.  Provide  a  detailed  test  schedule  prior  to  the  start  of  the  test  period. 

d.  Conduct  DLP  testing. 

e.  Maintain,  analyze,  and  report  DLP  test  results. 


f.  Determine  critical  and  non-critical  testing  issues,  and  actual  test  cases. 

g.  Perform  assigned  test  roles  as  directed  by  the  TMG. 


The  following  defines  tasking  responsibilities: 


a.  ACN-220  will  prepare  and  review  the  DLP's  Operational  Test  and 
Evaluation/Integration  Test  Plan  and  all  associated  procedures.  ACN-220  will 
also  review  compliance  of  test  programs  with  FAA  Orders  1810.4a  and  1600.54b,  and 
will  monitor  Installation  and  Checkout  (I&CO)  of  the  first  system.  They  will 
provide  support  to  the  Program  Manager  for  all  T&E  phases  and  will  be  responsible 
for  and  conduct  testing. 

b.  ACN-220  will  operate  and  maintain  the  test  facility  laboratories  and  the 
system  test  bed.  They  will  also  provide  scheduling  service  to  all  shared  resource 
laboratory  users. 

c.  ACD-320  will  provide  DATAS  for  extensive  functional  testing  of  the  Mode  S 
and  ADLP  systems  and  will  provide  the  ADLP  avionics  package  for  end-to-end  testing 
of  the  Mode  S  data  link. 

d.  ASM- 160  will  be  responsible  for  the  development  and  preparation  of  the 
Shakedown  Test  Plan  and  Test  Procedures  and  the  DLP  Maintenance  Handbook.  It  will 
be  responsible  for  and  will  conduct  shakedown  testing  at  the  FAA  Technical  Center. 

e.  AAC-942D  will  be  responsible  for  training. 

f.  ACN-230  will  provide  an  MPS  system  for  testing  the  interface  between  DLP 
and  the  MPS . 

g.  SEI  will  coordinate  and  assist  in  the  development  of  all  DLP  test  plans, 
procedures,  and  execution  activities. 

6,3  DLP  INTEGRATION  TEST  MANAGEMENT. 

6.3.1  Definition  of  Roles. 

Definitions  of  the  roles  involved  in  the  DLP  T&E  integration  and  verification 
effort  follows.  Every  defined  role  need  not  necessarily  be  staffed  for  every  test. 

6. 3. 1.1  DLP  Test  Director  (ACN-220). 

The  test  director  is  responsible  for  the  overall  management  of  the  DLP  Operational 
Test  and  Evaluation  effort,  for  conducting  pretest  and  post- test  briefings,  and  for 
the  collection  of  all  applicable  data  for  subsequent  analysis.  The  test  director 
provides  management  guidance  through  the  test  coordinator  and  other  members  of  the 
test  team. 

6. 3. 1.2  DLP  Test  Coordinator  (ACN-220). 

The  test  coordinator  is  responsible  for  the  overall  DLP  test  coordination  to  ensure 
that  individual  missions  are  properly  structured  and  mission  objectives  are 
accomplished.  The  test  coordinator  will  select  the  test  manager  for  each  test 
based  upon  suitability,  expertise,  and  availability.  The  test  coordinator  will 
work  with  the  test  director  on  unresolved  problems,  recommend  remedial  action,  and 
provide  general  support  to  the  test  director. 


6 .3. 1.3  DLP  Test  Manager. 

There  will  be  one  test  manager  per  test.  Issues  will  be  logically  addressed  by 
individual  test  procedures. 

The  test  manager  will  be  responsible  for  the  following: 

a.  For  the  conduct  of  the  specific  test  assigned. 

b.  To  ensure  that  all  required  equipment  and  personnel  are  available  prior  to 
the  test. 

c.  For  completion  of  the  open  item  status  sheet  described  in  section  7. 

d.  For  briefing  the  test  team  prior  to  the  test. 

e.  For  debriefing  the  test  team  after  the  test. 

f.  To  ensure  that  the  test  mission  leg  and  summary  described  in  section  7  are 
completed . 

g.  To  ensure  that  all  required  documentation  relevant  to  the  test  has  been 
completed . 

During  actual  testing,  the  test  manager  will  verify  compliance  with  the  test 
procedures  specified  for  the  test,  ensure  that  all  deficiencies  are  properly  noted, 
and  ensure  that  all  recorded  data  is  collected  and  forwarded  to  the  test 
coordinator  for  analysis.  The  test  manager  will  also  report  test  results  to  the 
test  coordinator. 

6. 3.1. 4  DLP  Test  Monitor. 

The  test  monitor  will  be  responsible  for  ensuring  that  test  scenarios  and 
procedures  are  being  followed  by  each  test  operator,  and  will  assist  the  test 
manager  in  verifying  that  test  data  flow  observations  and/or  measurements  are 
recorded  at  each  identifiable  mission  test  model  point.  The  test  monitor  will  also 
report  to  the  test  manager,  and  will  maintain  and  complete  the  test  observer  and 
test  monitor  notes. 

6 .3. 1.5  DLP  Test  Observers . 

Technically  qualified  test  observers  may  be  assigned  to  observe  and  record 
activities  for  specific  test  procedures,  and  to  provide  assistance  to  personnel 
staffing  the  test  positions.  Test  observers  will  also  assist  the  test  monitor  in 
maintaining  and  completing  the  test  observer  and  test  monitor  notes. 

6. 3. 1.6  DLP  Test  Operators . 

Test  operators  will  be  non-hardware/software  contractor  personnel  assigned  to  staff 
the  test  positions,  defined  by  the  DLP  Test  Procedures,  during  a  particular  test 
mission.  Test  operators,  under  the  direct  supervision  of  the  test  manager,  will 
conduct  the  test  in  accordance  with  the  DLP  Test  Procedures,  and  record  all  test 
anomalies  encountered  during  the  test. 
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6.4  DLP  TESTING  RESOURCE  REQUIREMENTS. 

The  following  sections  define  resource  requirements  for  facilities  and  personnel  to 
support  the  DLP  T&E. 

6.4.1  DLP  Facility  Requirements. 

The  facility  requirements  for  the  DLP  shall  be  as  presented  in  the  FAA  Technical 
Center  Transition  Plan. 

6.4.2  DLP  Personnel  Requirements. 

6 .4. 2.1  DLP  Test  Management  Group. 

The  personnel  requirements  for  the  test  management  group  are  as  stated  in 
section  6.1.1. 

6 . 4 . 2 . 2  DLP  Test  Conduc t . 

The  test  team  for  each  test  will  consist  of  one  test  manager,  one  test  monitor,  one 
or  more  test  operators  as  required  by  the  integration  test  procedures,  and  as  many 
test  observers  as  determined  by  the  DLP  test  management  group. 

6.4.3  DLP  Facility  Scheduling. 

The  test  manager  will  coordinate  scheduling  the  system  support  facility  and  other 
test  support  facilities  through  ACN-220,  as  discussed  in  section  9. 

6.4.4  DLP  Test  Software. 

The  test  coordinator  will  be  responsible  for  providing  the  appropriate  software  to 
be  used  in  conducting  the  integration  testing. 


7,  DLP  TEST  DOCUMENTATION  REQUIREMENTS  AND  CONTROL. 


7.1  DOCUMENTATION. 


This  section  describes  the  required  documents  for  planning,  conducting,  and 
reporting  the  DLP  T&E  Integration  activities.  The  required  verification 
documentation  consists  of  the  following: 


a.  Planning  Documentation 

1.  DLP  Project  Specifications 

2.  DLP  Test  Verification  Requirements  Traceability  Matrix  (TVRTM) 

3.  DLP  Test  Plan  (this  document) 

4.  DLP  Test  Procedures 

(a)  Preliminary  and  final  test  scenarios 

(b)  Preliminary  and  final  test  procedures 

(c)  Preliminary  and  final  test  analytics 
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b.  Testing  Documentation 


1.  Open  Item  Status  Sheet 

2.  Test  Mission  Log 

3.  Test  Observer  and  Monitor  Notes 

4.  Test  Evaluation  Summaries 

c.  Report  Documentation 

1.  Test  Discrepancy  Reports 

2.  Quick-Look  Test  Report 

3.  Final  Test  Report 

7.1.1  Planning  Documentation . 

7. 1.1.1  DLP  Project  Specifications. 

a.  FAA-E-2794a  Data  Link  Processor  Hardware  Specification 

b.  FAA-OR- 2802a  Data  Link  Processor  Software  Segment  Specification 

7 .1.1.2  DLP  TVRTM. 

The  DLP  TVRTM  is  contained  in  appendix  A  of  this  document . 

7. 1.1. 3  DLP  Operational  Test  and  Evaluation/Integration  Test  Plan. 

The  DLP  Operational  Test  and  Evaluation/Integration  Test  Plan  establishes  the 
interface  categories,  identifies  test  issues,  establishes  test  objectives, 
schedules,  resource  requirements,  methodology,  and  management  organization. 

7. 1.1. 4  DLP  Test  Procedures. 

Preliminary  and  final  versions  of  DLP  Test  Procedures,  addressing  all  DLP  test 
requirements,  will  be  produced  in  accordance  with  this  plan  and  FAA- STD- 024a, 
appendix  III.  This  document  will  contain  the  step-by-step  testing  instructions, 
scenarios,  required  inputs,  expected  outputs,  data  collection  forms,  and  methods  to 
be  employed  to  analyze  the  test  results  in  order  to  assess  compliance  of  the  DLP 
system  with  its  requirements. 

7,1,2  Test  Documentation . 

7. 1.2.1  Test  Mission  Log. 

7. 1.2 .1.1  Open  Item  Status  Sheet. 

Before  each  pretest  meeting,  the  test  manager  will  obtain  the  open  items  for  that 
test,  and  enter  them  on  the  open  item  status  sheet  as  shown  in  appendix  B.  The 
completed  sheets  will  become  the  first  part  of  the  test  mission  log,  and  will  be 
used  to  document  the  test  environment. 
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7,1.2. 1.2  Pretest:  Entries  . 

The  second  part  of  the  test  mission  log  will  be  entered  prior  to  test  start  and 
will  include  the  test  hardware  configuration,  the  test  software  configuration,  and 
the  list  of  participants  in  the  test. 

7.1.?  1.3  During  Test  Entries. 

During  the  test  run,  time-stamped  entries  will  be  made  in  the  test  mission  log  to 
indicate  all  significant  events  as  they  occur  including,  but  not  limited  to, 
start-up  procedures  initiated  and  completed,  data  produced,  problems  encountered, 
anomalies  and  deviations  observed,  and  shutdown  procedures  initiated  and  completed. 

7.1.7  M  Post-Test  Entries . 


Upon  completion  of  the  test,  the  test  mission  log  will  be  completed  with  entries 
providing  a  preliminary  assessment  of  the  test  results,  a  recapitulation  of 
anomalies  and  deviations  observed,  and  a  list  of  data  collected  and  appended  to  the 
test  mission  log. 

7. 1.2. 2  Test  Observer /Monitor  Notes. 

Test  observer/monitor  notes  will  be  maintained  by  the  test  monitor  and/or  each  of 
the  test  observers  to  record  all  relevant  events  occurring  during  each  test.  These 
notes  will  be  used  at  the  end  of  the  test  by  the  test  monitor  to  provide  the 
preliminary  assessment  of  the  test  results  to  be  included  in  the  test  mission  log 
at  the  end  of  the  test.  These  notes  will  be  appended  to  the  test  mission  log. 

7. 1.2. 3  Test  Evaluation  Summary . 

Test  evaluation  summaries  will  be  maintained  by  the  test  coordinator  and  will 
include  (1)  the  test  identification,  (2)  the  purpose  of  the  evaluation,  (3)  data  to 
be  evaluated,  (4)  evaluation  method,  and  (5)  evaluation  results.  The  test 
evaluation  test  summary  form  is  shown  in  appendix  B. 

7.1.3  Test  Results  Documentation . 

7, 1,3.1  Test  Discrepancy  Reports . 

The  test  manager  will  ensure  that  all  discrepancies  observed  during  the  test  are 
properly  documented  as  soon  as  possible  after  the  test.  These  discrepancies  will 
be  documented  using  the  proper  forms,  shown  in  appendix  B,  as  follows: 

a.  Hardware  related  problems  will  be  reported  on  FAA  Form  6030-3,  Hardware 
Discrepancy  Report  (HDR) ; 

b.  Program  (software)  problems  will  be  reported  on  FAA  Form  6100-1,  Program 
Technical  Report  (PTR) ; 

c.  Problems  related  to  a  maintenance  type  discrepancy  will  be  reported  on 
NAS  CT  Form  6100-29,  System  Support  Facility  Trouble  Report. 
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A  quick-look  test  report  will  be  prepared  by  the  test  director  for  each  test. 

The  report  will  consist  of  "as  run"  test  procedures  and  a  list  of  all  test 
discrepancies.  The  quick-look  test  report  will  be  distributed  to  appropriate  FAA 
and  contractor  organizations  within  10  working  days  after  test  completion. 


7. 1.3. 3  Final  Test  Report . 


A  final  test  report  will  be  prepared  at  the  direction  of  the  test  director  and 
forwarded  to  the  appropriate  organizations  in  accordance  with  FAA  Order  1810.4a. 
This  report  will  document  test  results  of  the  DLP  T&E  verification  program.  It 
will  include  information  obtained  from  (1)  all  recorded  data,  (2)  test  mission 
logs,  (3)  test  monitor/observer  notes,  (4)  discrepancy  reports,  (5)  test 
evaluation  summaries,  and  (6)  any  other  relevant  information.  In  addition,  it 
will  include  (1)  a  list  of  all  problems  and/or  concerns  found  during  testing, 

(2)  evaluation  of  any  operational  impacts  arising  from  these  problems  and  concerns, 

(3)  identification  of  any  outstanding  problems,  (4)  all  problems  that  have 

and  have  not  been  resolved,  (5)  all  test  results  (both  positive  and  negative) ,  and 
(6)  Conclusions  and  Recommendations. 


7.2  REVIEWS. 


The  following  subsections  identify  the  type  of  reviews  that  will  occur  during  DLP 
test  activities. 


Weekly  Status  Review  Meetings. 


The  weekly  status  review  meetings  will  serve  to  keep  the  DLP  T&E  support  groups 
abreast  of  the  status  of  the  T&E  effort.  These  meetings,  chaired  by  the  test 
director,  will  serve  as  a  forum  in  which  technical  interchange  may  occur  and 
appropriate  issues  and  concerns  discussed.  Test  plans,  test  procedures,  scenarios, 
and  analytics  will  be  reviewed  at  these  meetings. 


7.2.2  Monthly  Status  Review. 


These  meetings,  chaired  by  the  test  director,  will  provide  a  forum  for  the  test 
management  group  to  discuss  the  status  of  the  T&E  effort. 


7.2.3  Test  Readiness  Review 


This  meeting  will  review  the  test  procedures  and  approve  the  final  versions.  Data 
collection  will  begin  once  the  procedure  has  been  accepted. 


7.2.4  Pretest  Review . 


The  pretest  review,  convened,  and  chaired  by  the  test  manager  immediately  before 
testing,  will  establish  the  readiness  for  conducting  and  witnessing  a  particular 
formal  test.  The  review  will  include  the  status  of  prerequisites,  software,  system 
equipment,  and  test  equipment.  The  procedure  for  conducting  the  test  will  be 
presented,  and  any  deviations  from  the  DLP  test  procedures  will  be  indicated, 
discussed,  and  rationalized. 
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7.2.5  Post-Test  Review. 

The  post-test  review  will  be  convened  and  chaired  by  the  test  coordinator.  The 
full  test  team  will  attend  and  review  the  results  of  the  test  activity.  Anomalies 
and  discrepancies  will  be  noted  and  discussed.  An  assessment  will  be  made  of  the 
quality  of  the  test,  and  of  possible  adverse  impact  on  remaining  tests  due  to 
problems  encountered  during  the  test. 

7.2.6  Deployment  Readiness  Reviews  (DRRT . 

Deployment  Readiness  Reviews  (DRR)  will  be  prepared,  scheduled,  and  conducted  in 
accordance  with  FAA  Order  1810.4a,  and  ADL-1,  "Interim  Operating  Procedure  (IOP) 
for  NAS  Programs  Deployment  Readiness  Review  (DRR)  Process",  dated  February  1987. 
The  DRR  process  will  provide  the  status  on  all  of  the  DLP  project  activities, 
identify  open  issues,  and  enable  the  formulation  of  conclusions  and  recommendations 
to  these  issues.  The  DRR  also  ensures  that  adequate  attention  and  resources  are 
focused  on  these  issues  to  effect  timely  resolution  prior  to  deployment. 

The  DRR  process  commences  not  less  than  180  days  prior  to  the  scheduled  deployment 
of  the  DLP  project  to  the  first  operational  site,  and  includes  two  formal  DRR 
presentations  at  150  and  60  days  prior  to  the  deployment  date. 

Individuals  involved  with  the  DTP  Integration  Test  activities  should  be  prepared  to 
support  the  DRR  process  for  those  areas  identified  in  the  DRR  Checklist/ 
Responsibility  Matrix  of  the  IOP. 


8.  DLP  T&E  SCHEDULES. 


The  DLP  T&E  activity  utilizes  hierarchal  scheduling  techniques  that  provide 
traceability  from  the  daily  shared  resource  utilization  schedule  to  the  NAS  Program 
Master  Baseline  Schedule.  The  various  levels  of  the  schedule  are  milestone 
interlocked  for  quick  response  impact  assessment. 

The  schedule  is  maintained  in  the  Management  Information  Center  (MIC)  at  the  FAA 
Technical  Center.  Working  copies  are  disseminated  to  the  applicable  DLP  T&E 
Integration  test  organizations. 

The  DLP  T&E  scheduling  activities  are  in  compliance  with  the  "Master  Scheduling 
System  Functional  Description  Document  -  NAS  Transition  Phase"  (Draft) ,  dated 
March  1986 . 

The  Technical  Center  Test  Activities  Schedule,  traceable  to  the  long-range 
integrated  milestone  schedule,  provides  the  support  for  the  DLP  T&E  Integration 
Test  Program.  The  DLP  project  test  activity  schedule  identifies  the  individual 
task  start  and  complete  dates.  These  milestones  are  interlocked  to  the  long-range 
schedule  milestone  dates. 

The  30-day  Technical  Center  Utilization  Schedule  identifies  scheduled  facility 
utilization  for  all  activities  that  utilize  the  facilities.  It  will  be  used  to 
establish  priority  should  scheduling  conflicts  occur,  and  to  provide  information  to 
the  ACN  Facility  Control  Office  schedule.  Appropriate  ACN  Facility  Control  Office 
schedule  request  forms  are  completed  by  the  DLP  test  manager,  and  forwarded  to 
ACN-300.  The  facility  schedules  are  produced  and  distributed  by  ACN-300. 
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8.1  DLP  MAJOR  ACTIVITIES  SCHEDULE. 

Table  8.1-1,  DLP  Major  Activities  Schedule  depicts  the  major  activities  required  to 
complete  the  integration  testing  phase  at  the  FAA  Technical  Center.  The  actual 
project  delivery  to  the  T&E  site  is  contained  in  the  NAS  Program  Master  Baseline 
and  the  DLP  Project  Activity  Schedules. 


TABLE  8.1-1.  DLP  MAJOR  ACTIVITIES  SCHEDULE 


Number 

Ac tivitv/De script ion 

Date  Due 

1 

DLP  Master  Test  Plan 

Jan 

30, 

89 

2 

Operational  Test  and  Evaluation  (OT&E)/ 

Shakedown  Test  Plan  Approved 

May 

19  , 

89 

3 

OT&E/Integration  Test  Plan  Approved 

Nov 

02, 

89 

4 

System  Delivered  to  the  T&E  Site 
(FAA  Technical  Center) 

Mar 

06, 

90 

5 

Development  Test  and  Evaluation  (DT&E) 

Test  and  Analysis  Complete 

Mar 

20, 

90 

6 

DT&E  Test  Report  Complete 

Apr 

04, 

90 

7 

OT&E/Integration  Test  and  Analysis  Complete 

Jun 

06, 

90 

8 

OT&E/Integration  Test  Report  Complete 

Jul 

19, 

90 

9 

OT&E/Shakedown  Test  and  Analysis  Complete 

Jul 

12, 

90 

10 

OT&E/Shakedown  Test  Report  Complete 

Jul 

23, 

90 

11 

Test  Recommendation  to  DRR  Executive  Committee 

Jul 

24, 

90 
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9.  ABBREVIATIONS  AND  ACRONYMS. 


ADAS 

ADLP 

AIRMET 

ANST 

ASOS 

ATC 

ATCRBS 

AWOS 

CCITT 

COR 

CRT 

CTS 

DATAS 

DLP 

DP 

DRR 

DT&E 

ELM 

FAA 

FD 

FT 

ICAO 

ICD 

I&CO 

ID 

IMCS 


AWOS  Data  Acquisition  System 
Airburne  Data  Link  Processor 
Airmen's  Meteorological  Information 
American  National  Standards  Institute 
Automatic  Weather  Surface  Observing  System 
air  traffic  control 

Air  Traffic  Control  Radar  Beacon  System 
Automated  Weather  Observation  System 

Consultative  Committee  for  International  Telegraph  and  Telephone 

Correction 

Cathode  Ray  Tube 

Coded  Tiir  Source 

Data  Link  and  Transponder  Analysis  System 
Data  Link  Processot 
Data  Points 

Deployment  Readiness  Review 
Development  Test  and  Evaluation 
Extended  Length  Message 
Federal  Aviation  Administration 
Wind  and  Temperature  Aloft  Forecasts 
Terminal  Forecasts 

International  Civil  Aviation  Organization 
Interface  Control  Document 
Installation  and  Checkout 
Identification 

Interim  Monitoring  and  Control  Software 
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IOP 

ISH 

IT&E 

LAPB 

LU 

MIC 

MMC 

Mode  S 

MPS 

MSP 

NAS 

OSHA 

OT&E 

PPRH 

RMS 

R&PD 

RS 

SA 

SD 

SDR 

SEI 

SIGMET 

SLT&E 

SP 

TAF 

TBD 

TCO 


Interim  Operating  Procedure 
Intermediate  System  Hello 
Integration  Test  and  Evaluation 
Link  Access  Procedures  Balanced 
Logical  Unit 

Management  Information  Center 
Maintenance  Monitor  Console 
Mode  Select  Beacon  System 
Maintenance  Processor  System 
Long  Mode  S  Packet 
National  Airspace  System 

Occupational  Safety  and  Health  Administration 

Operational  Test  and  Evaluation 

Point-to-Point  Router  Hello 

Remote  Monitoring  Subsystem 

Reliability  and  Performance  Demonstration 

Record  Special  Observation 

Surface  Observations 

Radar  Summaries 

Site  Data  Report 

System  Engineering  and  Integration  Contractor 

Significant  Meteorological  Information 

System  Level  Test  and  Evaluation 

Special  Observation 

Terminal  Forecast 

Timing  Considerations 

Technical  Center  Operations 
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T&E 

TPDU 

TSDU 

TSPU 

TVRTM 

UA 

USP 

UUA 

UWS 

WA 

WMSC 

WMSCR 

WS 

UST 


Test  and  Evaluation 
Transport  Protocol  Data  Unit 
Transport  Service  Data  Unit 
Transport  Protocol  Data  Unit 

Test  Verification  Requirements  Traceability  Matrix 
Pilot  Reports 

Urgent  Surface  Observation 
Urgent  Pilot  Report 
Urgent  SIGMET 

Airmen's  Meteorological  Information 
Weather  Message  Switching  Center 
Weather  Message  Switching  Center  Replacement 
Significant  Meteorological  Information 
Convective  SIGMET 
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TVRTM  EXPLANATION. 


NAS  System,  Volume  II  Paragraph  Number . 

This  column  lists  the  DLP  NAS  System  requirements  as  specified  in  Volume  II  of  the 
NAS-1000  specification.  The  complete  statement  of  the  requirement  is  not  included 
in  order  to  concisely  tabulate  the  required  data.  (See  the  appropriate 
specification  document  for  complete  statements  of  the  requirements.)  Explanations 
for  abbreviations  appearing  in  this  column  are  as  follows: 

Verification  Method. 


T  Test .  Test  is  a  method  of  verification  where  performance  is  measured  through 
systematic  exercising  of  the  item  under  test  with  controlled  application  of 
functional  and  environmental  stimuli  and  collection,  analysis,  and  evaluation  of 
quantitative  data  to  determine  the  degree  of  compliance  with  preestablished 
quantitative  requirements. 

D  Demonstration.  Demonstration  is  a  method  of  verification  where  the  properties 
being  tested  are  determined  qualitatively  from  observations  alone;  stimuli  are 
applied,  and  the  responses  of  the  item  are  observed.  Demonstration  includes 
comparison  of  item  design  with  scientific  and  technical  principles,  procedures,  and 
practices  to  estimate  the  capability  of  the  design  to  meet  the  mission  and  system 
requirements.  It  also  includes  verification  by  visual  examination  of  the  item, 
reviewing  descriptive  documentation,  and  comparing  characteristics  with 
predetermined  standards. 

X  Not  Applicable. 

Cross  Reference  Column. 

Referenced  documents  listed  in  this  column  provide  explicit  requirements  of  the 
software  specifications  document  2802a  which  correlate  with  the  NAS  requirements. 

Remarks  and  or  Test  Category . 

Title .  Pertains  to  NA  test  method  entry.  The  cited  paragraph  is  simply  a  title; 
requirements  are  stated  in  the  following  subparagraphs. 

Category .  The  number  indicated  e.g.,  01,  02  ...  06  indicates  which  of  the  test 
categories  this  requirement  is  best  satisfied. 
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APPENDIX  B 

SAMPLE  FORMS  FOR  DLP  TESTING 


\ 


DLP  TEST  CONDUCT  LOG 


DEV ICE/ POSI TI ON : _ 

PAGE  of 

TEST: 

DATE:  / 

/ 

Procedure  Step 

Page 

Action  Output 

Produced 

Observations  Noted 

/  _ / 


/ 

/ 

/ 

/ 

/ 

_  /  . 

/ 

/ 

/  ... 

/ 

/ 

/ 

/ 

/ 

/  - 

/ 

/ 

/ 

/ 

/ 

TEST  MANAGER 

B-l 


TEST  MISSION  LOG 
OPEN  ITEM  STATUS  SHEET 


PROCEDURE  * 


PAGE  _ of 


TEST  MANAGER 


DATE  _ / _ / 


OPEN  ITEM  ID  NUMBER  DISPOSITION/ ACTION 


QUALITY 

CONCURRENCE 


B-2 


TEST  MISSION  LOG 


TEST  PROCEDURE  #  _ 

TEST  MANAGER  _ _ 

TEST  OBJECTIVES: 

(1) 

(2) 

(3) 

HARDWARE  CONFIGURATION 


PAGE 

DATE 


SOFTWARE  CONFIGURATION 


LIST  OF  PARTICIPANTS 

1. 

2. 

3. 

4. 
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TEST  SUMMARY  LOG 

TEST  NUMBER:  _ _  DATE: _ 

TEST  TITLE:  _  TEST  MANAGER:  _ 

PROCEDURE  DATA  RECORDED  SIGNIFICANT 

RESOLTS/OBSERV AT I ON 
NOTED 


STEP 


TEST  SUMMARY  LOG 


TEST  NUMBER; _ _ _  DATS:  _ / _ / 

TEST  TITLE: _ 

PRELIMINARY  ASSESSMENT  OF  TEST  RESULTS: 


ANOMALIES  and  DEVIATIONS: 


TEST  MANAGER 


B-5 


This  page  intentionally  left  blank. 


PL£AS£  TYPE 


PROGRAM  TECHNICAL  REPORT 


fj  OUPUICATE  PTfl 

EXISTS 


TYPE  QF  REPORT 


□  T  ROUBLE 
|  1  improvement 


TYPE  OF  FACILITY 


f  1  EN  ROU  r E 
Q  T  E  R Ml  N  Ai_ 


ORGANf  ZATION 


A  F 

n  »T 


PTR  NUMBER 

n 

D 
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R9 

D1 
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ARTS 

ONLY 

SUSPECTED 

SU  0P  ROGRAM 
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■ 
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■ 

■ 
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section 

[model 

m 

SYSTEM 

TAPE  10 

El 

a 

□ 

a 

m 

m 

■ 

■ 

■ 

■ 

■ 

■ 

■ 

■ 

REFERENCE(S) 


ATT  ACHMENT(S) 


DESCRIPTION  OF  PROBLEM 


ORIGINATOR’S  SIGNATURE 


ACTION  TAKEN  8Y  CENTRAL  PROGRAMMING 


CENTRAL  PROGRAMMING  USE  ONLY 

FACILITY  USE  ONLY 

DATE 

date 

«Nt  rt  ALS 

PTR  RECEIVED 

i  i 

PTR  RECEIVED  FROM  CENTRAL 

PROGRAMMING 

- 

»TR  01  ST  P*  8U  T  E  0  TO  SITES 

PATCH  AVAILABLE  FQ  R  USE 

patch  **■>  available  to  test 

GROUP 

_  .  . 

PATCH  VEPIFIEO 

patch  0 y  test  group 

PATCH  USED  OPERATIONALLY 

PATCH  0ISTR1BUTE0 

PATCH  NUMBER 

INDICATES  source  cooe  is  de¬ 
veloped  ANO  rill  0 E  ON  the 
indicated  SOURCE  tape 

SEE  REVERSE  SIDE  FOR  INSTRUCTIONS 

INSTRUCTIONS  FOR  COMPLYING  FAA  FORM  6100-1 


TROU  BLE  -  If  PTR  describes  an  out  of  spec  condition 

IMPROVEMENT  -  If  PTR  describes  an  improvement  and  does  not 
change  specifications. 

ENROUTE  -  TERMINAL  -  Check  one 

AF  -  AT  -  Check  the  service  of  the  PTR  originator. 

PTR  NO.  -  Box  l  A.  2  -  Contain  month. 

Box  U4  -  Contain  day  of  month. 

Box  5  -  Contains  last  digit  of  year. 

Box  7,  8  &  9  -  Each  site  shall  number  their  PTRs  se¬ 
quentially  starting  at  001  at  the  beginning  of  each 
calendar  year.  If  more  than  999  numbers  are  required 
Box  7  will  contain  an  alphabetical  character.  Box  10 
A  1 1  -  Identifies  the  originating  facility. 

SUSPECTED  SUBPROGRAM  -  The  name  (contraction)  of  the  sub¬ 
program  that  is  believed  to  cause  the  problem. 

SECTION  -  Assigned  by  central  programming  to  indicate  the  sec¬ 
tion  of  the  Program  Maintenance  Status  Report  (PMSR)  where  this 
PTR  is  documented. 

MODEL  -  Model  number  of  the  operational  computer  program  the 
PTR  is  written  against. 

VERSION  -  Version  number  of  the  model. 

SYSTEM  TAPE  ID  -  That  the  PTR  was  initially  identified  on. 

Box  23  -  A  —  Art* 

C  -  CCC 

0  -  one 

K  -  DCC 

Box  24  -  A  -  Operational  Program* 

D  -  Diagnostic  Programs 
M  —  Maintenance  Program* 

N  -  Support  Programs 
Box  25,26  A  27  —  Sequential  Number 
(3rd  digit  ma>  optionall  be  used  as  a  de— 
srri  pier) 

Box  28  -  Facility  Adaptation  Update  Level. 
Box  29  —  Facility  Patch  Update  Level. 


PRI  -  Enter  one  of  the  following. 

E  -  Emergency  is  a  problem  that  prevents  a  sue  from  continuing 
automation  activities  on  this  system  tape 

H  -  High  priority  is  a  prohlem  that  can  be  procedurally  handled 
but  has  an  adverse  affect  on  the  system 
L  -  All  others. 

REFERENCES  -  Indicate  the  document(s)  and  paragraph  thai  de- 
fine(s)  how  the  program  should  respond 

ATTACHMENTS  -  Indicate  what  type  and  number  of  attachments 

DESCRIPTION  OF  PROBLEM  -  State 

(a)  The  problem  in  detail. 

(b)  The  expected  results. 

(c)  The  actual  results. 

(d)  The  system  configuration  (if  pertinent) 

(e)  The  adaptation  if  unique  to  the  problem 
(0  Patches  that  may  be  a  factor. 

(g)  Route:  If  a  factor  (use  UDS  if  possible) 

(h)  Is  problem  transit  or  dupltcatabie^ 

(i)  Any  other  facts  considered  to  be  pertinent 

(j )  The  suggested  patch  if  one  is  available 

(k)  The  suggested  source  changes  (if  developed) 

ACTION  TAKEN  -  The  action  taken  to  resolve  the  problem  or 
close  the  PTR. 
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RIS:  AF  6030-10 


P/#o»*  Typ • 


HARDWARE  discrepancy  report 


hAROWARE  SUBSYSTEM 

H ARDWARE 
TYPE 

|  M AROWA  RE  , 

j  MODEL 

SYSTEM  _j 
TAPE 

j _ ! 

10 

DESCRIPTION  OF  PROBLEM 


Ou  PLICATE 
HOP 
EXISTS 


t 

9 

1  10 

" 

j  TYPE  FACILITY 

ORGANIZATION 

1 

1 

1 

1 

! 

1  . 

1  ! 

TERMINAL 

! 

1 

ORIGINATOR'S  SIGNATURE  ANO  ROUTING  SYMBOL 


AF-360  use  ONLY 


mor  received 


HOR  INCLUDED  IN  HMSR 


FIX  WAS  AVAILABLE  TO  TEST 


FIX  VERIFIED  BY  TEST  GROUP 


eem  distributed 


FAA  FORM  6030-3  *>721 


I  INITIALS  I 

I  facility  use  only 

DAT 

HOR  INCLUOEO  IN  HMSR 


EEM  AVAIL  A  Bt  E  FOR  USE 


EEM  INSTALLED 


EEM  NUMBER 


SEE  REVERSE  SIDE  FOR  INSTRUCTIONS 


INSTRUCTIONS  FOR  COMPLETING  FAA  FORM  60  30-3 


ENROUTE  •  TERMINAL  •  Check  one 

AF  •  AT  •  Check  the  service  of  the  PTR  originator 

HOR  No.  -  Box  1  4  2  -  Contain  month 

Box  3  4  4  *  C-utain  day  of  month 
Box  S  -  Contains  last  digit  of  year 
Box  7,  8  4  9  -  Each  site  shall  number  their 
HOR's  sequentially  starting  at  001  at  the  begin¬ 
ning  of  each  calendar  year.  If  more  than  999 
numbers  are  required.  Box  7  will  contain  an 
alphabetical  character. 

Box  10  4  I  1  -  Identifies  the  originating  facility. 

HARDWARE  SUBSYSTEM  •  Subsystem  utilizing  the  hardware 
for  which  the  HDR  is  written. 

HARDWARE  TYPE  -  Identification  of  hardware  tvpe  experi¬ 
encing  this  discrepancy. 

HARDWARE  MOOei-  •  identification  uf  hardware  m  -  fcl  ex¬ 
periencing  this  discrepancy. 

SYSTEM  TAPE  10  •  That  the  HDR  was  initially  identified  on: 

Box  23  -  A  -  ARTS 
C  -  CCC 
D  -  CDC 
E  -  DCC 

Box  24  -  A  -  Operational  Programs 
D  -  Diagnostic  Programs 
M  -  Maintenance  Programs 
N  •  Support  Programs 

°ox  25,  26  4  27  -  Sequential  No.  (3<t  digit  m“y 
optionally  be  used  as  a  descripter) 


Box  28  -  Facility  Adaptation  Lpdate  Level 
Box  29  -  Facility  Patch  I  pdate  Level 

PRI  -  E  nter  one  of  ihe  following; 

E  *  Emergency  is  a  problem  that  prevents  a  site  from 
continuing  automation  activities  on  this  system. 

H  •  High  priority  is  a  problem  that  cjn  be  procedurallv 
handled  but  has  an  adverse  affect  on  the  system. 

L  •  All  oiuers. 

REFERENCES  •  Indicate  the  document! si  and  paragraph  that 
definefs/  hovs  the  hardw«  «  should  respond. 

ATTACHMENTS  -  Indicate  what  type  and  number  of  atta:  h- 
ments. 

DESCRIPTION  OF  PROBLEM  -  State: 

fa)  The  problem  in  detail, 
lb)  The  expected  results. 

(c)  The  actual  results. 

(d)  The  system  configuration,  if  pertinent, 
le)  The  adaptation,  if  unique  to  the  problem. 

(f)  Patches  that  may  be  a  factor. 

(g)  Is  problem  transit  or  duplicatable’ 

(h)  Any  other  facts  considered  to  be  pertinent. 

(i)  The  suggested  fix,  if  one  is  available. 

ACTION  Taken  .  The  a  etion  taken  to  resolve  the  problem 
or  close  the  HDR. 


OPO  93A-999 
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